Pardus Testing Team

From PardusWiki
(Difference between revisions)
Jump to: navigation, search
(just typos + formats (for not interfering in current testing philosophy))
(Undo revision 3094 by Itycajofa (Talk) Spam.)
 
(3 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== Pardus Testing Team ==
+
This documentation is created by Semen Cirit in order to explain Pardus Linux Distribution Test Team Candidature and Test Processes. For suggestion and contribution please send mail: '''scirit{{at}}pardus.org.tr'''
 +
 
 +
= Pardus Test Team =
  
 
For every product or service that is produced by human beings, it is inevitable to contain bugs or errors. That's why quality assurance policies are needed for every product to decrease the rate of malfunctions.
 
For every product or service that is produced by human beings, it is inevitable to contain bugs or errors. That's why quality assurance policies are needed for every product to decrease the rate of malfunctions.
Line 5: Line 7:
 
The aim of the Pardus Testing Team is to minimize the rate of malfunctions before and after the releases. Another aim is to support the fixing of bugs as soon as possible.
 
The aim of the Pardus Testing Team is to minimize the rate of malfunctions before and after the releases. Another aim is to support the fixing of bugs as soon as possible.
  
== Contribution ==
+
= Contribution =
  
 
Free Softwares are not developed and maintained by only the developers but also by the people who volunteer to make translations, help bug-fixing, test, contribute in terms of graphics and package the software. Testing is a good starting point to begin to contribute to free software as it does not require much technical information and besides, helps in learning the softwares that are being tested.
 
Free Softwares are not developed and maintained by only the developers but also by the people who volunteer to make translations, help bug-fixing, test, contribute in terms of graphics and package the software. Testing is a good starting point to begin to contribute to free software as it does not require much technical information and besides, helps in learning the softwares that are being tested.
  
== How Can I Be a Member of Pardus Testing Team? ==
+
= How Can I Be a Member of Pardus Testing Team?=
 
+
We are expecting you to isolate the testing environment from your daily usage. You can ensure this via virtual machines, for testings inside Releases(packages, interim releases..etc.). However for testing the actual releases, testings before the releases, you definitely need a machine dedicated to this job.
+
 
+
Besides; you are expected to have basic skills of knowledge about Linux and Pardus. Although you are not expected to have a developer level of knowledge, questions like ''"What is your wireless card's name and its' vendor id?"'', ''"Can you add the repo at the address xxxxxx, and then upgrade the system?"'' should not sound unfamiliar to you.
+
 
+
You must register every computer you are going to use by filling the form at [http://cekirdek.pardus.org.tr/~serbulent/ptg_bilgi.ods this address] and then send it to psts{{at}}pardus.org.tr. A completed form can be seen  ''[http://cekirdek.pardus.org.tr/~serbulent/ornek.ods here]''.
+
 
+
== How are the things going on for the Testing Team before a Pardus Release? ==
+
 
+
Before every main release, a form is sent to the Pardus Testing Team Members, and they provide hardware information of the machines which they plan to use as a testing machine. For every system a number is assigned.
+
 
+
With every testing release, Pardus Testing Team Members make a fresh installation and fill in the form they are provided according to the test results in the form. After that, they send these forms to the tester list when the forms are wanted.
+
 
+
If any bugs appear, they are entered to [http://bugs.pardus.org.tr bugzilla] (the bug tracking system for Pardus) and can be tracked by the reporter and the Testing Team Responsible till the bug is closed.
+
 
+
Pardus Testing Team Members answer to the feedbacks from the Testing Team Responsible in a certain period of time and keep on doing these things till the stable release is announced.
+
 
+
====Reporting Before Release Tests====
+
 
+
After the release announcement, the Pardus Testing Team starts testing with the help of the guide they are provided with.<br>
+
The succesful steps are signed as:
+
 
+
1.1 Yes<br>
+
1.2 Yes<br>
+
1.3 Yes<br>
+
 
+
but the steps that are failed should be written in detail as much as possible and be added to the final report. The final report is send to the tester list via e-mail as a "plain-text" . The header of the post should be in the form of "Test No:NN  Sistem-XXX" .
+
 
+
== How about the Tests during a Release? ==
+
 
+
Tests during a Release are different from Before-The-Release Tests as this kind of tests start at the beginning of the new stable release and go on till the release is maintained officially. That kind of Tests are seperated into two groups:
+
*"Upgrade Tests" and
+
*"Function Tests"
+
 
+
====Upgrade Tests====
+
 
+
For that kind of testing mechanism, you should have a freshly installed version of both the stable release ( e.x. Pardus-2007 ) and interim versions of this release ( e.x. 2007.1 , 2007.2 , 2007.3 ). After every Test process, as we are going to need a fresh version of these installations, installing these systems as a virtual image (e.x. using VirtualBox, see [[HOWTO:VirtualBox]]) is useful for your own health :) We are going to use these images in update tests.
+
 
+
Besides, we need another virtual image that is periodically upgraded from the stable repository after every repo updates.
+
 
+
The Process generally works in that way: the Testing Team Responsible starts an ACK process for the packages waiting in the testing repository. The packages that receive ACK from the developers are merged to the current stable repository and to a temporary repository consisting of newly ACK'ed packages. Freshly installed releases are given the address of this temporary repository and being upgraded from this repository.
+
 
+
Every upgraded release is being tested after restarting the system, in order to learn whether the system is capable of doing basic things or not. After this, it is checked with ''revdep-rebuild'' command to control if any broken distributed library files in reverse dependencies are missing.
+
 
+
====Function Tests====
+
 
+
For the Function Tests, the actual version of the latest stable release is upgraded from the testing repository and every upgraded program is being tested one by one.
+
 
+
 
+
<center>[[Image:Surum ici1.jpg]]</center>
+
  
  
After you make an installation once on a virtual machine (such as VirtualBox - more at: [[Virtualization:Contents]]), you can take a screenshot of your machine every time you upgrade it to the latest version of the stable repository, so that you can use this image(screenshot) for your upcoming tests. That prevents installing the same packages every time you use a machine upgraded to the latest version of the repository.
+
== You need to know a few detail before participating to Pardus Test Team ==
  
The upgraded release is being tested after restarting the system, in order to learn whether the system is capable of doing basic things or not. After this, it is checked with ''revdep-rebuild'' command to control if any broken distributed library files in reverse dependencies are missing.  
+
::* '''For develpment version test processes:''' You have to accept the risk of losing data and systems on your machine. (For every development version test, you can take a backup of your system to an external harddisk.).
  
As testing all the characteristics of the programs and the libraries by the Members of Pardus Testing Team isn't possible in terms of knowledge, experience and time; the packages are classified in 3 categories:  
+
::* '''For daily usage:''' Testing environment can not be isolated from daily usage. For your individual system you have to use <pre>http://packages.pardus.org.tr/pardus-x-test/pisi-index.xml.bz2</pre> repository. (x means the related Pardus version. For example pardus-2009-test.)
*[[Packages to be tested in details]]
+
*[[Packages to be tested in normal standards]] and
+
*[[Packages to be tested only in installation]].
+
  
====Testing Repository Adresses====
+
::Thanks to daily usage of test repository, you will be in [http://www.wikihow.com/Make-Adhoc-Testing-More-Effective ad-hoc test process] at any moment.
  
*For Pardus 2007 : http://paketler.pardus.org.tr/testci-2007/pisi-index.xml.bz2
+
::For evey bug that you find, you have to report it to [http://bugs.pardus.org.tr/ Pardus bug tracking system] with assistance of [[How:Efficient Bug Reporting | efficient bug reporting]] documentation.
*For Pardus 2008 : http://paketler.pardus.org.tr/testci-2008/pisi-index.xml.bz2
+
*For Pardus 2009 : ''to be added''
+
  
== Before Reporting Any Bugs ==
+
::* '''For stable version test processes:''' You can reserve a partition for stable version tests. This system repository will be a repository which is created by test supervisor for stable test process. The tamplate for this repository <pre>http://packages.pardus.org.tr/tester-x/pisi-index.xml.bz2</pre>. (x means Pardus system version. Örneğin tester-2009.)
  
* If you get an installation error, check sha1sum of the image you have downloaded. Burn the CD at DAO mode and at most 16x speed and check if your CD is OK.
+
==For participating Pardus Test Team==
  
* When you get an error, try to understand the error message. Be sure that the reason of the problem isn't your program settings. Do not forget that [http://www.google.com Google] is your best friend.
+
You will be pass the Pardus Test Team Candidature process before being a test team member. After this proocess you will be well aware about Pardus Linux Distribution infrastructure, and can find bugs and also can find a way to resolve bugs. After send an e-mail to '''pardus-test{{at}}pardus.org.tr''', you will be a pardus test team candidate.  
  
* Try to repeat the GUI errors by starting the program from console. Attach the error log from the console to your error report.
+
From that moment you will take a [http://svn.pardus.org.tr/uludag/trunk/doc/test/tester-quiz.txt test team member quiz] in order to learn Pardus Linux Distribution infrastructure and bug finding, fixing and reporting. You can consult your mentor if you’re unable to locate answers. For consulting the mail adress is also '''pardus-test{{at}}pardus.org.tr'''.
  
* Try to repeat the error with the latest stable version of the package. Attach the result to your error report.
+
After answering these questions properly, you will be a Pardus test team member!!! İndeed the moderator will affirm your test team list membership.
  
== See also ==
+
=Pardus Test Süreçleri=
*[http://www.ozgurlukicin.com/forum/pardus-2008-test-takimi/  Pardus 2008 Test Team] (Turkish language)
+
  
[[tr: Pardus Test Gönüllüsü Olmak]]
+
::* [http://en.pardus-wiki.org/Development_Verison_Test_Process Development Version Test Process]
[[Category:Pardus]]
+
::* [http://en.pardus-wiki.org/Stable_Version_Test_Process Stable Version Test Process]
[[Category:Tests]]
+

Latest revision as of 13:59, 30 November 2010

This documentation is created by Semen Cirit in order to explain Pardus Linux Distribution Test Team Candidature and Test Processes. For suggestion and contribution please send mail: scirit@ @.pngpardus.org.tr

Contents

Pardus Test Team

For every product or service that is produced by human beings, it is inevitable to contain bugs or errors. That's why quality assurance policies are needed for every product to decrease the rate of malfunctions.

The aim of the Pardus Testing Team is to minimize the rate of malfunctions before and after the releases. Another aim is to support the fixing of bugs as soon as possible.

Contribution

Free Softwares are not developed and maintained by only the developers but also by the people who volunteer to make translations, help bug-fixing, test, contribute in terms of graphics and package the software. Testing is a good starting point to begin to contribute to free software as it does not require much technical information and besides, helps in learning the softwares that are being tested.

How Can I Be a Member of Pardus Testing Team?

You need to know a few detail before participating to Pardus Test Team

  • For develpment version test processes: You have to accept the risk of losing data and systems on your machine. (For every development version test, you can take a backup of your system to an external harddisk.).
  • For daily usage: Testing environment can not be isolated from daily usage. For your individual system you have to use
    http://packages.pardus.org.tr/pardus-x-test/pisi-index.xml.bz2
    repository. (x means the related Pardus version. For example pardus-2009-test.)
Thanks to daily usage of test repository, you will be in ad-hoc test process at any moment.
For evey bug that you find, you have to report it to Pardus bug tracking system with assistance of efficient bug reporting documentation.
  • For stable version test processes: You can reserve a partition for stable version tests. This system repository will be a repository which is created by test supervisor for stable test process. The tamplate for this repository
    http://packages.pardus.org.tr/tester-x/pisi-index.xml.bz2
    . (x means Pardus system version. Örneğin tester-2009.)

For participating Pardus Test Team

You will be pass the Pardus Test Team Candidature process before being a test team member. After this proocess you will be well aware about Pardus Linux Distribution infrastructure, and can find bugs and also can find a way to resolve bugs. After send an e-mail to pardus-test@ @.pngpardus.org.tr, you will be a pardus test team candidate.

From that moment you will take a test team member quiz in order to learn Pardus Linux Distribution infrastructure and bug finding, fixing and reporting. You can consult your mentor if you’re unable to locate answers. For consulting the mail adress is also pardus-test@ @.pngpardus.org.tr.

After answering these questions properly, you will be a Pardus test team member!!! İndeed the moderator will affirm your test team list membership.

Pardus Test Süreçleri

Personal tools
Namespaces
Variants
Actions
Navigation
Print/export
Toolbox